MapReduce-based Web Log Mining Preprocessing

doi:10.3969/j.issn.1006-2475.2013.09.008

Computer and Modernization ›› 2013, Vol. 1 ›› Issue (9): 35-37,4.doi: 10.3969/j.issn.1006-2475.2013.09.008

• 人工智能 • Previous Articles Next Articles

MapReduce-based Web Log Mining Preprocessing

MAO Yan-qi, PENG Pei-fu

School of Physics and Information Science, Hunan Normal University, Changsha 410081, China

Received:2013-03-25 Revised:1900-01-01 Online:2013-09-17 Published:2013-09-17

Abstract

Abstract: This article describes the general process of Web log mining and focuses on the study of Web session division in the preprocessing of Web log mining. The article introduces the concept and advantages of cloud computing. For the bottleneck analysis of Web log mining, as well as the difficulties of data storage and sharing, we proposed MapReduce-based Web log mining preprocessing, which can better solve the efficiency issues currently faced in Web log mining and better integrate the computer resources to reduce unnecessary waste.

Key words: Web log mining, MapReduce, session division

CLC Number:

TP311

MAO Yan-qi;PENG Pei-fu. MapReduce-based Web Log Mining Preprocessing[J]. Computer and Modernization, 2013, 1(9): 35-37,4.

[1]	SHI Hui1, CHEN En2. Distributed Stage Adaptive Association Rules Mining Algorithm Based on Spark [J]. Computer and Modernization, 2019, 0(12): 31-.
[2]	SONG Yang, SHI Hong-yan. Improved K-means Clustering Algorithm Based on MapReduce Framework [J]. Computer and Modernization, 2019, 0(08): 28-.
[3]	CHEN Lijuan, XIE Huosheng. A Parallel Algorithm for Mining onshelf Utility Itemset with Negative Item Values [J]. Computer and Modernization, 2018, 0(04): 13-.
[4]	ZHANG Chun, ZHOU Jing. esearch and Application on Association Rule Mining Optimization Algorithm for High Speed EMU Malfunction [J]. Computer and Modernization, 2017, 0(9): 74-78.
[5]	XU Huan1, FENG Jun1, ZHANG Peng-cheng1, TANG Zhi-xian2, LIU Yi1, CHEN Zhi-fei1, ZHANG Li-xia1. Distributed CIF Quadtree Indexing Method Based on Hadoop [J]. Computer and Modernization, 2016, 0(11): 12-19,24.
[6]	XU Yuanbin. Energysaving Optimization Model Under Big Data Environment #br# Based on Genetic Algorithm [J]. Computer and Modernization, 2016, 0(10): 25-29.
[7]	CAI Ming， ZUO Yongan. A Hybrid Ant Colony Algorithm Based on MapReduce [J]. Computer and Modernization, 2016, 0(10): 6-.
[8]	WANG Hao. Scheduling Strategy of Reduce Task Based on Data Localization in Hadoop [J]. Computer and Modernization, 2016, 0(1): 114-120.
[9]	HU Long, LUO Jun. Hybrid Join Algorithm Based on MapReduce [J]. Computer and Modernization, 2015, 0(6): 86-91.
[10]	LIU Shu-ying. A Top-k Closest Pairs Data Search Scheme Based on MapReduce [J]. Computer and Modernization, 2014, 0(8): 38-45.
[11]	LENG Yong-lin. Distributed AP Clustering Algorithm Based on MapReduce [J]. Computer and Modernization, 2014, 0(10): 104-107.
[12]	GU Rui-chun1, WANG Jing-yu2. A Parallel Clustering Model Based on MapReduce [J]. Computer and Modernization, 2014, 0(1): 90-92,108.
[13]	XIA Da-wen;RONG Zhuo-bo. Research and Application of Key Technology of Hadoop [J]. Computer and Modernization, 2013, 1(5): 138-141,.
[14]	MA Qiao;WAN Jianyi;WANG Mingwen. A Scalable Coclustering Algorithm Based on MapReduce [J]. Computer and Modernization, 2013, 1(11): 52-57.
[15]	XU Shuai. Research on Enforcing Privacy Security in MapReduce Based on Decentralized Information Flow Control [J]. Computer and Modernization, 2012, 1(03): 93-97.

MapReduce-based Web Log Mining Preprocessing

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments